Nonnegative Rank Factorization via Rank Reduction
نویسندگان
چکیده
Abstract. Any given nonnegative matrix A ∈ R can be expressed as the product A = UV for some nonnegative matrices U ∈ R and V ∈ R with k ≤ min{m, n}. The smallest k that makes this factorization possible is called the nonnegative rank of A. Computing the exact nonnegative rank and the corresponding factorization are known to be NP-hard. Even if the nonnegative rank is known a priori, no simple numerical procedure exists that can calculate the nonnegative factorization. This paper is the first to describe a heuristic approach to tackle this difficult problem. Based on the Wedderburn rank reduction formula, the idea is to recurrently extract, whenever possible, a rank-one nonnegative portion from the previous matrix, starting with A, while keeping the residual nonnegative and lowering its rank by one. With a slight modification for symmetry, the method can equally be applied to another important class of completely positive matrices. Numerical testing seems to suggest that the proposed algorithm, though still lacking in rigorous error analysis, might serve as an initial numerical means for analyzing the nonnegative rank factorization.
منابع مشابه
Fast Nonnegative Matrix Factorization with Rank-one ADMM
Nonnegative matrix factorization (NMF), which aims to approximate a data matrix with two nonnegative low rank matrix factors, is a popular dimensionality reduction and clustering technique. Due to the non-convex formulation and the nonnegativity constraints over the two low rank matrix factors (with rank r > 0), it is often difficult to solve NMF efficiently and accurately. Recently, the altern...
متن کاملLower bounds on matrix factorization ranks via noncommutative polynomial optimization
We use techniques from (tracial noncommutative) polynomial optimization to formulate hierarchies of semidefinite programming lower bounds on matrix factorization ranks. In particular, we consider the nonnegative rank, the positive semidefinite rank, and their symmetric analogues: the completely positive rank and the completely positive semidefinite rank. We study the convergence properties of o...
متن کاملOn Reduced Rank Nonnegative Matrix Factorization for Symmetric Nonnegative Matrices
Let V ∈ R be a nonnegative matrix. The nonnegative matrix factorization (NNMF) problem consists of finding nonnegative matrix factors W ∈ R and H ∈ R such that V ≈ WH. Lee and Seung proposed two algorithms which find nonnegative W and H such that ‖V −WH‖F is minimized. After examining the case in which r = 1 about which a complete characterization of the solution is possible, we consider the ca...
متن کاملHeuristics for exact nonnegative matrix factorization
The exact nonnegative matrix factorization (exact NMF) problem is the following: given an m-by-n nonnegative matrix X and a factorization rank r, find, if possible, an m-by-r nonnegative matrix W and an r-by-n nonnegative matrix H such that X = WH . In this paper, we propose two heuristics for exact NMF, one inspired from simulated annealing and the other from the greedy randomized adaptive sea...
متن کاملA Symmetric Rank-one Quasi Newton Method for Non-negative Matrix Factorization
As we all known, the nonnegative matrix factorization (NMF) is a dimension reduction method that has been widely used in image processing, text compressing and signal processing etc. In this paper, an algorithm for nonnegative matrix approximation is proposed. This method mainly bases on the active set and the quasi-Newton type algorithm, by using the symmetric rank-one and negative curvature d...
متن کامل